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Summary of Review 

This report concludes that autonomy is a prerequisite for innovative and effective 
charter schools to emerge. Especially important is freedom from external bureaucratic 
control. Yet there is nothing in this report that addresses levels of autonomy in relation- 
ship to financial performance, resource allocation practices, academic results, and other 
key school characteristics and outcomes. Beyond anecdotal evidence, the authors fail to 
empirically demonstrate whether and how authorizers’ constraints have had an adverse 
impact upon any of the examined four key areas of school autonomy: staffing, instruc- 
tional programming, governance, and culture. 




Review 



I, Introduction 

The basic structure of charter school laws sets 
up a contract; in return for greater autonomy 
than that enjoyed by regular public schools, 
charter operators agree to be held accountable 
for meeting certain goals. That is, charters are 
expected to take advantage of fewer operating 
restrictions in return for promises to use that 
freedom responsibly and successfully. 

The authors of Charter School Autonomy: A 
Half-Broken Promise^ claim, however, that 
state-level and authorizer-level constraints on 
school autonomy have undermined the time, 
resources, and energy devoted to the operation 
of charter schools. This claim would have 
been more useful if it were backed up by solid 
empirical evidence. In particular, while the 
report provides some evidence concerning the 
type and source of some constraints, it is miss- 
ing evidence establishing the level of con- 
straints on charter autonomy or how such con- 
straints adversely affect school performance. 
In recent years, studies on different aspects of 
charter schools have moved away from being 
largely rhetorical toward being increasingly 
empirical. This report, unfortunately, does not 
follow that trend. 

II, Findings and Conclusions 
OF THE Report 

The report focuses on the two levels of re- 
strictions that can be included for charter 
schools: those freedoms not included in 
state-level grants of charter autonomy, and 
restrictions placed on charter school appli- 
cants by local authorizers. The following are 
the main findings of the report; 

• Although state laws maintaining some 
limitations on charter freedom are the 



primary source of impediments to char- 
ter school autonomy, 60% of charter 
school authorizers imposed additional 
impediments beyond state laws. On av- 
erage, authorizer contracts restrict the 
charter schools’ overall autonomy 
“grade,” given by the report’s authors, 
from a B+ to a B-. 

• Charter school authorizers such as 
school districts, institutions of higher 
education and mayors have imposed the 
greatest impediments to charter autono- 
my, while nonprofit organizations, state 
departments and boards of education 
have imposed the least. 

• Charter schools were likeliest to face 
restrictions on the hiring of uncertified 
teachers (95%), contract revisions 
(70%), staff compensation (47%), board 
composition (45%), special education 
(45%), budget (31%), policy waivers 
(39%), discipline policies (28%), and 
management contracting (25%). 

• Charter schools have the greatest auton- 
omy over curricula, school calendars, 
teacher work rules, staff dismissal, and 
procurement policies. 

Ill, The Report’s Rationale for 
Its Findings and Conclusions 

The rationale underlying the report’s con- 
clusions is largely rhetorical, not empirical. 
The report asserts the relevance of flexibility 
(freedom from many policies and regula- 
tions affecting regular public schools) and 
autonomy (control over decisions) as central 
to charter school reform. It argues that free- 
ing charter schools from overly stringent 
bureaucratic regulations imposed by autho- 
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rizer contracts, policies and practices would 
provide greater resources to develop innova- 
tive and effective charters. 

An issue that is not discussed in the report is 
that charter school autonomy comes at a 
price; state educational bodies that authorize 
charter schools bargain autonomy for accoun- 
tability."^ The purpose of this autonomy-for- 
accountability trade-off is to bring about a 
better balance between enforcement of ac- 
countability requirements and autonomy over 
school-level operations. Charter school au- 
tonomy is not an end in itself, but a necessary 
means for the accomplishment of the 
school’s measurable expectations, justified 
pragmatically by its contribution to more ef- 
fective performance. On the other hand, the 
accountability practices of charter authorizers 
are meant to protect the public investment 
and interest in quality education outcomes. 

IV, Review of the Validity of 

THE Findings and Conclusions 

The report finds wide variability in terms of 
the restrictiveness of charter school laws 
across states. Arizona, California, Pennsyl- 
vania, and Texas, for example, all received 
A’s from the report’s authors for the amount 
of autonomy they afford their charters.^ (Be- 
cause the authors favor autonomy, a higher 
grade is their shorthand way of identifying 
the state laws they prefer.) 

The report asserts that “the states that scored 
high on the autonomy index also tend to be 
the ones with lots of charter schools,” and it 
suggests that “states extending high levels of 
autonomy to schools also tend to be freer 
with charter caps and enable organizations 
other than districts to authorize schools, both 
of which encourage more charter schools to 
form” (p. 5). These assertions are flawed 
and unwarranted. 



In Table 1 (see Appendix), using data from the 
National Association of Charter School Au- 
thorizers,^ it appears that the patterns of the 
report’s high levels of autonomy are asso- 
ciated with the presence of at least three types 
of authorizers per state. Except for Wisconsin, 
states with a variety of authorizing options 
(i.e., Arizona, California, Minnesota, Ohio, 
and Texas) also are associated with high char- 
ter school enrollment and the number of char- 
ters that are established. Contrary to what the 
report claims, the level of school autonomy 
varies not by the type of charter authorizer but 
by a variety of authorizing options. Table 1 
disputes the report's claim that higher educa- 
tion institutions (HEIs) and school dis- 
tricts/local education agencies (LEAs) are as- 
sociated with low levels of autonomy. Rather, 
states with more authorizing options are linked 
to patterns associated with high autonomy 
grades and total number of charters. With 
multiple types of chartering authorities, char- 
ter applicants may have fewer barriers to entry 
and more opportunities to self-select based on 
preferred authorizing standards/practices. 

Moreover, the report fails to draw a distinction 
between either (a) the total number of charter 
schools authorized by the state and the rate of 
charters authorized per year, or (b) the percen- 
tage this represents of the total number of 
schools in the state. Eor example, although 
New York and Minnesota have a similar 
number of approved charter schools, the for- 
mer has 29 charters^ due to open for the 2010 

o 

school year, while the latter has one. Similar 
caution should be exercised when comparing 
the total number of charters authorized at the 
district level (the most prevalent authorizer in 
the report's sample) and the rate of charters 
authorized by the districts per year. 

The report also explores different autonomy 
restrictions, which vary by authorizer, char- 
ter type and state law context. But it fails to 
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examine the context of local pressures and 
other players that create barriers to autonomy 
and school entry. For example, the high au- 
tonomy restrictions in Tennessee and Mary- 
land may be a consequence of high entry bar- 
riers through bargaining or political opposi- 
tion that limited the number of providers 
willing or available to step forward to create 
new charters. The report fails to triangulate 
across interviews with different respondents 
(e.g., teachers, principals, school administra- 
tors and support staff, charter board members 
and founders, and EMOs/CMOs) to deter- 
mine the level of constraints placed on au- 
tonomy. Rather, much of the evidence of 
constraints on charter school autonomy 
comes from a limited pool of stakeholders at 
or near the center of the chartering world. 

The accounts on state-imposed restrictions 
rely entirely on anecdotal evidence to de- 
termine the degree of autonomy experienced 
by the sampled schools across the fourteen 
indicators. Outside of anecdotal data, there 
is no empirical evidence to link authorizers’ 
impact on any of the key areas of school au- 
tonomy to adverse academic outcomes or 
financial performance. The report fails to 
associate potential adverse performance out- 
comes with any restrictions to school auton- 
omy and to thereby examine the actual sta- 
tus of the 100 charters in its study sample. 

Finally, the report uses cross-sectional inter- 
views to capture a snapshot of the varying le- 
vels of autonomy restrictions. This approach 
doesn’t allow for any meaningful causal con- 
clusions. In particular, whether the level of 
constraints (autonomy index) imposed by state 
authorizers has increased across years is 
beyond the scope of this report. A longitudinal 
analysis of authorizers’ impact on autonomy 
would have indicated its relationship to factors 
such as total number of charters, total charter 
enrollment and school outcomes. 



There are also four additional concerns, all 
of which seem immediately relevant to the 
report’s intent, which are not addressed in 
the report. Although any single (relatively 
short) study cannot address all these items, I 
offer them here as questions readers might 
ask in relation to the report’s suggested 
causal inferences. 

• Has the number of authorizer contract 
restrictions increased or decreased over 
time or stayed the same? Are authorizer 
constraints most stringent at the applica- 
tion phase (entry-level)? Does the expe- 
rience gained from authorizing and over- 
seeing charter schools (high-quality over- 
sight and accountability processes) result 
in fewer or more restrictions over time? 

• Is there a relationship between autonomy 
scores/grades and the number of years 
the charter schools have operated in the 
state? Is there an association between re- 
striction levels and the revocation of 
charters from year to year? Are charter 
revocations (more specifically, the rate 
of charter renewals) and closures (the 
rate of actual closures) better measures 
of authorizer restrictions than autonomy 
scores? Which elements of authorizer 
contracts are most likely to lead to 
school closure? 

• What exactly are the impacts of the sup- 
posedly overly restrictive statutes and au- 
thorizer contract restrictions on each of 
the four key areas of school autonomy — 
staffing, instructional programming, go- 
vernance, and culture? Can the impacts 
be quantifiably measured using outcome 
measures at the school level? Does the 
level of authorizer restrictions vary over 
time, and does it have an adverse impact 
on academic outcomes and financial per- 
formance of charter schools? 
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• What differentiates charters from tradi- 
tional public schools in terms of meas- 
ures of school performance, and how might 
this difference be attributed to autonomy? 

V, The Report’s Use of 
Research Literature 

The report's limited research citations are 
generally studies from other pro-charter 
think tanks and organizations rather than 
from academic literature. There is a dearth 
of references to peer-reviewed research, 
such as the large body of literature that ad- 
dresses the link between governance and 
transparency^ and the autonomy-for- 
accountability trade-off, which includes 
accountability for results in terms of perfor- 
mance," public accounting of costs for qual- 
ity control, transparency in the allocation 
of resources," and compliance with laws 
that are not waived in areas such as health 
and safety and special education." 

VI, Review of the Report’s 
Methods 

The report is based on the examination of 
charter school laws in the 26 states that con- 
tain the largest percentage of charter 
schools, as well as the authors’ inspection of 
charter school contracts for 100 schools as- 
sociated with some of the nation’s most ac- 
tive authorizers, and their interviews with 
expert stakeholders tied to those schools and 
authorizers — charter school leaders, autho- 
rizers, and state association representatives. 

This approach raises several potential sources 
of bias and methodological inadequacies. 
First, the individuals who were interviewed 
may have only a narrow perspective focused 
on their own job functions. They may also 
have a bias in favor of fewer constraints on 
charter autonomy. Second, this group of in- 
terviewees may exclude key informants with 



knowledge and insights about the policies 
and practices within a given state or school. 
For example, teachers and school administra- 
tors may be in the best position to determine 
whether purported constraints affect the way 
schools are governed, the allocation of teach- 
ing resources, instructional programming, 
schools’ culture/mission, schools’ financial 
position, or schools’ level of academic per- 
formance. Without triangulating across inter- 
views with such diverse respondents, it is not 
possible to obtain a reasonably accurate pic- 
ture of constraints on operational autonomy. 

But perhaps the most obvious and important 
flaw in this study is the arbitrariness of the 
report’s scoring, weighting and grading sys- 
tem. The report’s interpretation of the effects 
on autonomy of each state’s statute language 
leaves a lot of room for arbitrariness in the 
metric scores and grade ranges. Moreover, 
those grade ranges are designed to present an 
evaluative judgment regarding the “impact on 
autonomy’’ of the laws and authorizer con- 
tracts, which translates into a judgment of the 
extent of their school-level restrictions on au- 
tonomy. In addition, there is an unavoidable 
assumption that must be accepted before a 
reader can give credence to the study’s review 
of 100 charter school contracts: the weights 
assigned to each of the 14 areas of charter au- 
tonomy cannot be justified unless it is as- 
sumed that each plays a role in bringing about 
an impact on school performance. But no sys- 
tematic evidence is offered to back up that as- 
sumption. In the end, the report’s weighting of 
autonomy measures and the assigning of letter 
grades across a range of average scores are 
essentially an arbitrary exercise. 

VII, Usefulness of the Report 
FOR Guidance of Policy 
AND Practice 

The rhetoric of the report and the approach- 
es used suggest a clear goal of championing 
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charter school autonomy, but the positive 
impact of such autonomy is assumed, not 
proven. The report shows little regard for 
providing a careful analysis of the question 
at hand; whether autonomy can stimulate 
school innovation and effectively allocate 
resources. The report’s methods do not 
measure up to this purpose, and the report’s 
significant biases and omissions undermine 
its potential for valid findings. 

The report does not further our understand- 
ing of this issue and is of little or no help in 



guiding policy for charter school authoriz- 
ers, state legislators, school district leaders, 
donors, school leaders, teachers, parents, or 
even charter school supporters. Even after 
more than a decade of experience, surpri- 
singly little is understood about the entities 
responsible for authorizing and overseeing 
charter schools. This new report does not 
help, but it does highlight the need for a 
careful, empirical examination of the evolv- 
ing nature of state laws on charter schools, 
incorporating amendments and lifting prohi- 
bitive caps on charters. 
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Appendix 



Table 1: State and School Autonomy Grades 



State 



Year 

Law 

Passed 



Authorizers 



#of 

Charter 

Schools 



#of 

Charter 

Students 

Enrolled 



State 

Charter 

Law 

Autonomy 

Grade 



State 

Autonomy 

Grade 

Ranges 



AZ 


1994 


LEA, ICB, 
SEA 


507 


106,030 

(9%) 


A 


A- 


CA 


1992 


LEA, RIA, 
SEA 


820 


315,509 

15%L__ 


A- 


A- to B4- 


CO 


1993 


LEA, ICB 


157 


66,043 

(8%) 


C 


C- to D+ 


CN 


1996 


LEA, SEA 


18 


5,408 

(1%> 


c+ 


C+toC 


DC 


1996 


LEA, ICB 


57(on 97 
campuses) 


29,305 

(38%) 


D- 


D- 


FL 


1996 


LEA 


416 


129,645 


B 


CtoF 


GA 


1993 


LEA, ICB 


85 


47,394 (2%) 


C-H/C-H 


C+ to D/F 


ID 


1998 


LEA, ICB 


36 


12,796 (4%) 


B- 


B to D- 








39 


37,512 

(2%) 






IL 


1996 


LEA 


(on 106 
campuses) 


B+ 


B- 


IN 


2001 


LEA, HEI, 
MUN 


53 


20,576 (2%) 


B 


BtoC 


LA 


1995 


LEA, SEA 


77 


30,684 (4%) 


B/B- 


D/B- 


MD 


2003 


LEA, SEA 


36 


12,570 (1%) 


F 


F 


MA 


1993 


SEA 


62 


27,695 (3%) 


B+ 


B+ 


MI 


1993 


LEA, RIA, 
HEI 


240 


106,275 

,£6%I 


B 


Cto D+ 






LEA, RIA, 










MN 


1991 


SEA, HEI, 
NFP 


152 


37,165 (4%) 


B 


BtoC-H 


NH 


1995 


LEA, SEA 


10 


1,217 (0%) 


B- 


B- to C+ 


NM 


1993 


LEA, SEA 


72 


13,505 (4%) 


D- 


D- 


NY 


1998 


LEA, SEA, 
HEI 


144 


47,602 (1%) 


B- 


C-rtoC 


NC 


1996 


SEA, LEA, 
HEI 


96 


35,265 (3%) 


B+ 


B+ 


OH 


1997 


LEA, RIA, 


328 


102,910 


B 


B to B- 


HEI, NFP 


15%L_ _ 


PA 


1997 


LEA, SEA 


135 


75,940 (4%) 


A- 


B+ 


TN 


2002 


LEA 


22 


5,605 (0%) 


D+ 


D+ 
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State 


Year 

Law 

Passed 


Authorizers 


#of 

Charter 

Schools 


#of 

Charter 

Students 

Enrolled 


State 

Charter 

Law 

Autonomy 

Grade 


State 

Autonomy 

Grade 

Ranges 


TX 


1995 


LEA, SEA, 
HEI 


281 

(on 557 
campuses) 


145,518 

(3%) 


A- 


A- to B-l- 


UT 


1998 


LEA, ICB 


72 


30,123 (5%) 


C+ 


c+ ■ 


WI 


1993 


LEA, HEI, 
MUN 


206 


336,533 

(4%) 


C/F 


F 


Total^ 






4,364 


1,251,342 







Notes: (1) Local Education Agency (LEA), Regional/Intermediate Agency (RIA), State 
Education Agency (SEA), Independent Chartering Board (ICB), Higher Education Institu- 
tion (HEI), Municipal Office (MUN), Not-For-Profit Organization (NFP). (2) Percentages 
shown in column five refer to the percent of charter school students to all public school 
students. 

Sources: National Association of Charter School Authorizers (2009). Principles and Stan- 
dards for Quality Charter School Authorizing] National Alliance for Public Charter Schools 
Dashboard (www.publiccharters.org/dashboard/reports); Brinson, Dana and Jacob Rosch 
(2010). Charter School Autonomy: A Half Broken Promise. The Fordham Institute. 
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